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TITLE OF THE INVENTION 

INFORMATION PROCESSING SYSTEM, INFORMATION PROCESSING 
APPARATUS, AND COMPUTER -READABLE RECORDING MEDIUM 

5 

P A CKGROUNP OF T H E I NV E N TI ON 
Field of the liyyentlon 

The present invention relates to information processing 
systems, information processing apparatuses, and computer- 

0 readable recording media used in the systems or the 

apparatuses, suited to cases in which electronic -watermark 
information is embedded in input information, such as 
digital image data or digital sound data, to protect 
copyright, to prevent forgery, and to record various types 

5 of information. 

De scr ip tion of the Related Art 

As computers and networks have been remarkably 
developed in recent years, various types of inf ormation , 
such as character data, image data, and sound data, feas- been 

0 handled in the computers and networks . Since such data is 

digital, it can be easily copied with its quality maintained. 
Therefore, to protect the copyright of such data, copyright 
information and user information are embedded in image data 
and sound data as electronic-watermark information 

5 (hereinafter just called an electronic ( watermark) in many 
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cases . 

With the use of an electronic- watermark technology, 
information which people cannot recognize with their senses 
of sight and hearing is confidentially embedded in image 
5 data or sound data. When an embedded electronic watermark 
is extracted from image data or sound data, copyright 
information, user information, and identification 
information are obtained, and illegitimate copying can be 
traced. 

10 A first condition required for such an electronic 

watermark is a quality at which embedded information cannot 
be identified, namely, at which information is embedded in 
the original digital information such that the quality of 
the original digital information does not deteriorate. 

15 A second condition is robustness with which information 

embedded in the original digital information remains, namely, 
with which embedded information is not lost even if editing, 
such as data compression and filtering, or an attack is 
applied. 

20 A third condition is the amount of information to be 

embedded, which can be selected according to use. 

These conditions, required for electronic watermarks, 
are generally tradeoffs to each other. When an electronic 
watermark having a high robustness is generated, for example, 

25 relatively large quality deterioration occurs and the amount 



3 - 



of information to be embedded becomes small in many cases . 

Methods for embedding electronic watermarks in multi- 
valued still pictures can be divided into two types, 
spatial -domain embedding methods and frequency- domain 
5 embedding methods . 

In each of various electronic -watermark embedding 
methods, embedding processing corresponds to extracting 
O processing one by one, and there <axe no compatibility. In 
m general, it is said that spatial -domain embedding methods 
ijLO provide low quality deterioration with ^ low robustness, 
C§ whereas frequency-domain embedding methods provide jl high 

" robustness with jk relatively high quality deterioration. 
rf s Each method has a different feature, such as a high 

robustness with a small amount of embedded information, or a 
Ol5 high quality with a low robustness. 

To protect embedded information, information 
(hereinafter called a key) indicating algorithm, embedding 
positions, and changes are kept confidential in many cases. 
This is to enhance robustness to an intentional attack in 
20 which the algorithm and embedding positions are analyzed to 
remove electronic watermarks . 

It can be considered to efficiently protect copyright 
that a monitoring organization for checking whether 
illegitimate copying is performed, by extracting electronic 
25 watermarks is provided. It is important for such a 
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monitoring organization to keep the electronic -watermark 
method used and the key confidential to avoid an intentional 
attack. 

As described above, there are various electronic- 
5 watermark methods each having its f eatures . There are also 
many companies and associations which want to prevent 
illegitimate copying and illegitimate outputting of digital 
Q data by the use of electronic watermarks. If such companies 
m and associations independently select electronic-watermark 
Q10 methods to embed electronic watermarks in data, since 
rj| embedding processing and extracting processing correspond 
~ one by one in each of electronic -watermark methods and they 
!H are not compatible, the following problems occur. 
^ 1. It is difficult for one monitoring organization to 

Ol5 perform united checking because electronic-watermark 
extracting processing is needed for each method. 

2. To perform united checking by one monitoring 
organization, the monitoring organization needs to have all 
electronic -watermark extracting techniques, causing a large 

20 load. 

3. The monitoring organization needs to manage the 
keys corresponding to all the extracting techniques 
confidentially and strictly. 

4. When a monitoring organization is provided for each 
25 method, if an embedded electronic watermark cannot be 
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extracted, it cannot be determined whether the embedded 
electronic watermark has been generated by a different 
method, or the electronic watermark broken by an attack. 
One monitoring organization refers to one configuration 
5 in terms of a system or a method, determined by 

standardization or a nation, rather than one physical 
organization. 

Jjj SUMM A RY O F THE I NV E NTION 

NiO Accordingly, it is an object of the present invention 

to efficiently protect copyrighted materials in various 
= electronic-watermark methods. 

Lj The foregoing object is achieved in one aspect of the 

,J3 present invention through the provision of an information 

5l5 processing system in which a plurality of information 

processing apparatuses are connected through a network, at 
least one of the plurality of information processing 
apparatuses including first adding means for adding first 
additional information to input information by a first 
20 adding method; and second adding means for adding second 

additional information to the input information by a second 
adding method, wherein the first adding method has a higher 
robustness than the second adding method. 

The foregoing object is achieved in another aspect of 
25 the present invention through the provision of an 



information processing system in which a plurality of 
information processing apparatuses are connected through a 
network, at least one of the plurality of information 
processing apparatuses including first extracting means for 
5 extracting first additional information from input 
information by a first extracting method; and second 
extracting means for extracting second additional 
O information from the input information by a second 
Iff extracting method identified by the extracted first 
SJlO additional information. 

The foregoing object is achieved in still another 
aspect of the present invention through the provision of an 
Z\ information processing apparatus including first adding 

-zf means for adding first additional information to input 
2 15 information at a high robustness by a first adding method; 
and second adding means for adding second additional 
information to the input information by a second adding 
method. 

The foregoing object is achieved in yet another aspect 
20 of the present invention through the provision of an 

information processing apparatus including first extracting 
means for extracting first additional information from input 
information by a first extracting method; and second 
extracting means for extracting second additional 
25 information from the input information by a second 



extracting method identified by the extracted first 
additional information. 

The foregoing object is achieved in still yet another 
aspect of the present invention through the provision of an 
5 information processing method including a first adding step 
of adding first additional information to input information 
at a high robustness by a first adding method; and a second 
D adding step of adding second additional information to the 
Ul input information by a second adding method. 

SJ10 The foregoing object is achieved in a further aspect of 

sa the present invention through the provision of an 

£ information processing method including a first extracting 

jy step of extracting first additional information from input 

\SJ information by a first extracting method; and a second 

J=fl5 extracting step of extracting second additional information 
from the input information by a second extracting method. 

The foregoing object is achieved in a still further 
aspect of the present invention through the provision of a 
computer-readable recording medium for storing a program, 
20 the program including a first adding step of adding first 
additional information to input information at a high 
robustness; and a second adding step of adding second 
additional information to the input information. 

The foregoing object is achieved in a yet further 
25 aspect of the present invention through the provision of a 





- 8 - 



computer -readable recording medium for storing a program, 
the program including a first extracting step of extracting 
first additional information from input information; an 
identifying step of identifying an extracting method by the 
5 extracted first additional information; and a second 

extracting step of extracting second additional information 
from the input information by the identified extracting 
method. 



SjlO invention will become clear by the following figures and 
ij descriptions. 



^15 electronic -watermark embedding in an information processing 
system according to a first embodiment of the present 
invention. 

Fig. 2 is a block diagram of a portion related to 
electronic-watermark extracting in the information 
20 processing system according to the first embodiment of the 
present invention . 

Fig. 3 is a block diagram of a portion related to 
electronic-watermark embedding in an information processing 
system according to a second embodiment of the present 
25 invention. 



Other objects and other features of the present 



B RI EF DES C R IP TI O N QF T H E DR AWING S 



Fig. 1 is a block diagram of a portion related to 
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Fig. 4 is a block diagram of a portion related to 
electronic-watermark extracting in the information 
processing system according to the second embodiment of the 
present invention . 

Fig. 5 is a block diagram of a portion related to 
electronic-watermark extracting in an information processing 
system according to a third embodiment of the present 
invention . 

Fig. 6 is a block diagram of a portion related to 
electronic -watermark embedding and extracting in an 
information processing system according to a fourth 
embodiment of the present invention. 

Figs. 7A and 7B are block diagrams of an electronic- 
watermark embedding apparatus and an electronic -watermark 
extracting apparatus , respectively. 

DE SC R IP TI O N OF T H E PREFE R R E D EMBODIMEN TS 
( First embodiment ) 

Fig. 1 shows a portion related to electronic -watermark 
20 embedding in an information processing system according to a 
first embodiment of the present invention. This system uses 
a common electronic-watermark method and electronic- 
watermark methods unique to monitoring organizations . The 
common electronic -watermark method refers to an electronic- 
25 watermark method determined by standardization or related 
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organizations, and the features thereof will be described 
later. 

In Fig. 1, organizations 101 to 104 perform electronic- 
watermark embedding processing with the use of different 
5 electronic -watermark methods. In the organizations 101 to 
104, common- electronic -watermark embedding apparatuses 105 
perform electronic-watermark embedding processing by the 
predetermined common electronic -watermark method, and a 
type-A-electronic-watermark embedding apparatus 106, a type- 

10 B-electronic-watermark embedding apparatus 107, a type-C- 
electronic-watermark embedding apparatus 108, and type-D- 
electronic -watermark embedding apparatus 109 perform 
electronic -wat earmark embedding by electronic -watermark 
methods independently determined by the organizations 101 to 

15 104, respectively. A network 110 eeftnee^ the organizations. 
The organizations 101 to 104 have communication means, not 
shown, for connecting to the network 110. 

The common electronic -watermark method, which the 
common -electronic -watermark embedding apparat us- 105 uses^ 

20 has the following features. 

1. Implements high-robustness electronic watermarks 
with a relatively small amount of information. 

2. Extracts electronic watermarks without keys or with 
a common key. 

25 3. Embeds information which identifies at least each 




- 11 - 

electronic-watermark method or the organization which has 

performed embedding by the use of the method. 

4. Has robustness to electronic-watermark embedding 

performed by each organization. 
5 5. Sets a variable level of robustness in steps or 

continuously by the decision of each organization and 

attaches data indicating a robustness strength to 

information in which electronic watermarks are embedded, as 

additional information . 
10 Various electronic-watermark methods having the 

foregoing methods can be considered. A method having a high 

robustness will be taken below as example. 

Fig. 7A shows an electronic-watermark embedding 

apparatus for performing the above-described embedding 
15 processing, and Fig. 7B shows an electronic -watermark 

extracting apparatus for performing the above- described 

extracting. 

When a still picture is input as input data serving as 
a copyrighted material, the image data of the still picture 

20 is divided into eight -by-eight -pixel blocks and discrete 
cosine transform (DCT) is applied to each block. 
Hereinafter, a DCT-transf ormed block is called a DCT 
coefficient block, one coefficient in a DCT coefficient 
block is called a DCT coefficient, and a set of DCT 

25 coefficient blocks for one sheet of picture is called a DCT 
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coefficient block group . 

In the electronic -watermark embedding apparatus shown 
in Fig. 7A, an image transform unit 701 applies DCT to an 
input image "x" and the output of the image transform unit 
5 701, a DCT coefficient block group, is input to an 

electronic -watermark embedding unit 702. The electronic- 
watermark embedding unit 702 selects one DCT coefficient 
block to be embedded among the input DCT coefficient block 
group, and quantizes one DCT coefficient in the DCT 
10 coefficient block to embed one embedding bit. 

The size of a quantization step corresponds to the 
intensity of embedding, and the size of the quantization 
step and the position of the selected DCT coefficient 
correspond to key information. 
15 As an example, the value of a DCT coefficient located 

at the coordinates "u" and " v" is called s{u, v}, a 
quantization step is called "h," and an electronic-watermark 
bit of 0 or 1 is embedded by the following rule. 

ah < s{u, v} <; (a + l)h (1) 
20 The following operation is executed, and a coefficient 

used after embedding is set to c{u, v} . 

c{u, v} = bh + h/2 for an embedding bit of 0 (2) 

where b is whichever of "a" and (a + 1) is even. 

c{u, v} = bh + h/2 for an embedding bit of 1 (3) 
25 where b is whichever of "a" and (a + 1) is odd. 
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Lastly, an inverse -image -transform unit 703 applies 
inverse DCT to the block group to change it back to eight - 
by- eight -pixel blocks and reconstructs them. Then, an image 
"y" in which the electronic watermark has been embedded is 
5 obtained. 

In the present embodiment, a setting unit 706 for 
variably setting the size of a quantization step and/or an 
embedding position to variably specify a robustness strength 
is provided. This setting unit sets the above factors 
10 according to various parameters such as a security level, 
automatically or by a manual operation of a person who 
monitors . 

Data indicating the specified robustness strength is 
attached to the original data as additional information at a 
15 subsequent stage of the inverse-image-transform unit 703. 

According to this data, an extracting operation is specified 
at an extracting side. 

The additional information may be common among the 
organizations, or may be encrypted so that a third party 
20 cannot obtain the robustness strength. 



25 which has been embedded with key information among a DCT 




v* 1 

watermark extracting unit 705 selects a DCT coefficient 
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coefficient block group to which the same DCT is applied. 




"b" which satisfies the following expression is obtained, 
when n b" is even, it is determined that the embedding bit is 



0, and when "b" is odd, it is determined that the embedding 



5 



bit is^y. 

bli < c{u, v} ss (b + l)h (4) 



A method for enhancing the robustness in this embedding 
p method will be described below. 

J When a DCT coefficient indicating a low- frequency 

CjlO component is selected from a DCT coefficient block as a DCT 
rl coefficient to be embedded, the robustness is made strong. 

^ This is because, whereas high-frequency components are 

H; likely to be lost due to image compression or various types 

t^U of filtering processing, low-frequency components are 

Ol5 unlikely to be lost. 

In the above embedding method, one DCT coefficient 
block is selected and one DCT coefficient is embedded. The 
number of DCT coefficient blocks to be selected and the 
number of DCT coefficients to be embedded can be increased 
20 to enhance the robustness. When only one DCT coefficient is 
embedded for one bit, it is highly possible that the value 
of the bit is lost due to image compression and various 
types of filtering processing. When the identical bits are 
embedded in a plurality of DCT coefficients, it is not 
25 highly possible that most of them are lost. 
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The robustness can be enhanced by applying error- 
correcting encoding to bits to be embedded themselves. This 
is because, even if some of the embedded bits are lost, they 
are recovered by an error-correcting code. It is clear that 
5 the robustness becomes stronger when the used error- 
correcting code has a higher error- correcting capability. 
Although the above techniques enhance the robustness, they 
may change low-frequency components of an image, or the 
quality of the image may deteriorate since many bits are 

10 embedded. Since identical bits are embedded with the use of 
many DCT coefficients, a small number of bits are embedded 
in many cases. If an inverse operation is performed, the 
robustness becomes weaker, but image quality is satisfactory 
and a large amount of information can be embedded in an 

15 electronic-watermark method. 

The robustness -strength setting unit 706 may change the 
robustness strength by shifting an embedding position from a 
high-frequency side to a low-frequency side, or by changing 
the number of items to be embedded. 

20 The above -described techniques for enhancing the 

robustness have the same tendency not only for methods 
employing DCT but also for methods employing wavelet 
transform or Fourier transform and methods for directly 
manipulating the luminance of a pixel. 

25 An embedding procedure will be described below by 
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referring to Fig. 1. For simplicity, 00, 01, 10, and 11 are 
embedded by the common electronic -watermark method, which 
are two-bit information for identifying the organizations 
101 to 104. It is clear that other types of information can 
5 be embedded. 

Each of the organizations 101 to 104 embeds the bit 
corresponding to each organization in distributed data by 
the common electronic -watermark method which has the above - 
described features 1 to 5 and has a high robustness with the 

10 use of the common -electronic -watermark embedding apparatus 
105. Then, other types of information J-^embedded with the 
use of the type-A to type-D electronic -watermark embedding 
apparatuses 106 to 109 unique to the organizations. When 
the common electronic -watermark method does not interfere 

15 with an electronic -watermark method unique to an 

organization, namely, when electronic- watermark embedding 
processing does not affect the common electronic -watermark 
information, the embedding order can be reversed. In each 
organization, a different piece of information may be 

20 embedded. Alternatively, the same information may be 

embedded. Each organization can embed various types of 
information, such as copyright information, user information, 
and identification information. 

Fig. 2 shows a portion related to electronic-watermark 

25 extracting in the first embodiment. 



In Fig. 2, there are provided a united monitoring 
organization 200, and electronic -watermark monitoring 
organizations 201 to 204 corresponding to the organizations 
101 to 104 shown in Fig* 1, respectively. The united 
5 monitoring organization 200 has a common- electronic - 

watermark extracting apparatus 205 corresponding to the 
common -electronic -watermark embedding apparatus 105, and the 
organizations 201 to 204 include a type-A-electronic- 
watermark extracting apparatus 206, a type-B-electronic- 

10 watermark extracting apparatus 207, a type-C-electronic- 

watermark extracting apparatus 208, and a type-D-electronic- 
watermark extracting apparatus 209 corresponding to the 
type-A to type-D electronic-watermark embedding apparatuses 
106 to 109 shown in Fig. 1, respectively. A network 210 

15 connects the organizations 201 to 204. The organizations 
201 to 204 have communication means, not shown, for 
connecting to the network 210. The network 210 may be 
identical with the network 110 shown in Fig. 1. 

An electronic -watermark extracting procedure to be 

20 executed in Fig. 2 will be described below. 

The united monitoring organization 200 monitors data 
distributed or used in the network 210. If data which seems 
to be an illegitimate copy is found or reported on the 
network, the monitoring organization 200 extracts 

25 information embedded by the common electronic-watermark 
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method, by the use of the common-electronic-watermark 
extracting apparatus 205. With this operation, the 
organization which embedded the information or the used 
method is identified, and the data is sent to the identified 
5 organization. 

The organization which receives the data extracts 
various types of embedded information, by the use of the 
electronic-watermark extracting apparatus thereof, which is 
either of the type-A to type-D electronic-watermark 

10 extracting apparatuses 206 to 209. 

According to the present embodiment, even in a system 
which uses different electronic-watermark methods in a mixed 
way, each organization only needs to manage an embedding 
section and an extracting section for its own electronic- 

15 watermark method, without preparing embedding sections and 
extracting sections for many electronic -watermark methods. 
Illegitimate copying is efficiently monitored. 

Even when an electronic watermark is not found, safety 
is enhanced for the following reasons. If electronic- 

20 watermark information is not found, it is difficult to 
differentiate among whether the data does not include 
electronic-watermark information from the beginning, whether 
an electronic watermark has been embedded by another method, 
and whether electronic-watermark information is broken by an 

25 attack. Since the common electronic-watermark method has a 
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high robustness, it is difficult for an attack to break 
electronic -watermark information generated by the method. 

Therefore, when electronic -watermark information 
generated by the common electronic -watermark method is 
5 extracted in a first process, a possibility of not having 
electronic-watermark information from the beginning is 
eliminated. An electronic -watermark method unique to each 
organization may be used. When detailed information is 
embedded, a large amount of information is embedded and an 

10 electronic-watermark method having a relatively low 

robustness with suppression of quality deterioration being 
- focucod on is used in many cases. Therefore, after 
v electronic-watermark information generated by the common 
electronic-watermark method is extracted, when electronic- 

15 watermark information generated by the electronic-watermark 
method unique to each organization is not found, it can be 
said that electronic -watermark information has been broken 
by an attack. 

Therefore, overall safety has been improved by this 
20 system, as compared with a case in which each organization 
independently uses a unique electronic -watermark method. 

In the present embodiment, four organizations are 
included. It is clear that the present invention can also 
be applied in the same way to a system having any number of 
25 organizations. 
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( Second embodiment ) 

Fig. 3 shows a portion related to electronic -watermark 
embedding in an information processing system according to a 
second embodiment of the present invention. In the present 
5 embodiment, only a common -electronic -watermark embedding 
organization 300 uses the common electronic -watermark 
embedding apparatus 105 for embedding. 

Organizations 301 to 304 only have the type-A to type-D 
electronic -watermark embedding apparatuses 106 to 109, which 

10 use the unique electronic -watermark methods. The 

organizations 301 to 304 are formed by removing the common- 
electronic -watermark embedding apparatuses 105 from the 
organizations 101 to 104 shown in Fig. 1. A network 110 
connects the organizations 301 to 304. 

15 A united copyright management organization, such as 

Japanese Society for Right of Authors , Composers and 
Publishers (JASRAC) for musical copyrighted materials, can 
serve as the common -electronic -watermark embedding 
organization 300. Sales shops which sell the users 

20 copyrighted materials controlled by the common-electronic- 
watermark embedding organization 300 can serve as the 
organizations 301 to 304. The present embodiment does not 
limit cases to which the present invention is applied. The 
present invention includes all techniques in which the 

25 common -electronic -watermark method having a high robustness 
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and an electronic -watermark method unique to each 
organization are used according to conditions . 

The organizations 301 to 304 (including each copyright 
holder) register copyrighted materials at the organization 
5 300 and ask it to execute embedding with the use of the 
common -electronic -watermark embedding apparatus 105. The 
organization 300 embeds predetermined information by the 
common electronic-watermark method, and sends back data to 
the organizations 301 to 304. The organizations 301 to 304 

10 use the type-A to type-D embedding apparatuses 106 to 109, 
which employ the unique electronic -watermark methods, to 
embed various types of information. 

The present embodiment has the following advantages 
over the first embodiment. 

15 In the first embodiment, since each organization 

performs embedding by the common electronic- watermark method, 
the common electronic -watermark method and its key need to 
be made public to each organization. It is better to keep 
the common electronic -watermark method and its key 

20 confidential for safety. If even one organization leaks 

information, the entire safety cannot be maintained. In the 
present embodiment, however, since the common electronic- 
watermark method does not need to be made public to the 
organizations 301 to 304, safety is enhanced. 

25 The present embodiment can be combined with the first 
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embodiment. When, in Fig. 3, the organizations 301 and 302 
have the common electronic-watermark embedding apparatuses 
105 in the same way as in the first embodiment, for example, 
the organizations 303 and 304, which do not have the common 
5 electronic -watermark apparatus 105, performs the same 
processing as in the present embodiment, and the 
organizations 301 and 302, which have the common electronic- 
watermark apparatuses 105, can embed the predetermined 
information by the common electronic-watermark method within 

10 their organizations, as in the first embodiment. 

Fig. 4 shows a portion related to electronic -watermark 
extracting in the information processing system according to 
the second embodiment . 

In Fig. 4, a united monitoring organization 400 

15 includes the common-electronic-watermark extracting 

apparatus 205, corresponding to the common-electronic- 
watermark embedding apparatus 105, and the type-A to type-D 
electronic-watermark extracting apparatuses 206 to 209, 
corresponding to the type-A to type-D electronic -watermark 

20 embedding apparatuses 106 to 109 which employ the 

electronic-watermark methods unique to the organizations. A 
network 210 connects to the organizations 301 to 304, 
although they are not shown in Fig. 4. Instead of the 
organizations 301 to 304, the organizations 101 to 104 may 

25 be connected to the network 210. 
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An electronic -watermark extracting procedure to be 
executed in Fig. 4 will be described below. 

The organization 400 monitors data distributed or used 
in the network 210. If data which seems to be an 
5 illegitimate copy is found or reported on the network, the 
organization 400 extracts information embedded by the common 
electronic-watermark method, by the use of the common- 
electronic-watermark extracting apparatus 205. With this 
operation, the organization which embedded the information 
10 or the used method is identified. Then, various types of 



extracting apparatus which employs the electronic-watermark 
method unique to the identified organization. 

In the system according to the present embodiment, only 

15 the united monitoring organization can monitor illegitimate 
copying. Such a united monitoring organization can be 
implemented if a finite number of electronic-watermark 
methods unique to organizations are used. Since the 
electronic-watermark method unique to each organization is 

20 identified by the common electronic -watermark method, it is 
not necessary to check an electronic watermark with the 
electronic-watermark method unique to each organization by 
trial and error, and therefore the system is efficient. 




The united monitoring organization does not need to 



25 



have the electronic-watermark methods unique to all 
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organizations from the beginning. When the used embedding 
organization is identified by electronic -watermark 
information obtained by the common electronic-watermark 
method, it is possible that the united monitoring 
5 organization asks the embedding organization to send the 
extracting means employing the electronic-watermark method 
unique to the organization and its key. 
(Third embodiment) 

Fig. 5 shows a portion related to electronic-watermark 
10 extracting corresponding to the electronic -watermark 
embedding shown in Fig . 1 or Fig . 3 . 

In Fig. 5, organizations 501 to 504 have the common- 
electronic-watermark extracting apparatuses 205, 
corresponding to the common -electronic -watermark embedding 
15 apparatus 105, and the type-A to type-D electronic -watermark 
extracting apparatuses 206 to 209, corresponding to the 
type-A to type-D embedding apparatuses 106 to 109 employing 
the electronic-watermark methods unique to the organizations, 
respectively . 

20 An electronic -watermark extracting procedure to be 

executed in Fig. 5 will be described below. 

Each of the organizations 501 to 504 monitors data 
distributed or used on the network 210. If data which seems 
to be an illegitimate copy is found or reported in the 

25 network, the organization extracts information embedded by 
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the common electronic-watermark method, by the use of the 
common -electronic -watermark extracting apparatus 205. With 
this operation, the organization which embedded the 
information or the used method is identified. When it is 
5 determined that the organization employs the used method, it 
extracts information by the electronic -watermark extracting 
apparatus unique to the organization. When it is determined 
that another organization employs the used method, a notice 
is sent to the organization or the obtained information is 

10 discarded, according to conditions. 

In the system according to the present embodiment, 
illegitimate copying can be monitored without having a 
united monitoring organization. This system can be applied 
to either of the embedding systems shown in Fig. 1 and Fig. 

15 3. It is also clear that the extracting systems shown in 

Fig. 2 and Fig. 4 can be applied to either of the embedding 
systems shown in Fig. 1 and Fig. 3. 

The system shown in Fig. 5 can be combined with that 
shown in Fig . 2 and that shown in Fig . 4 . When the 

20 organization 200 according to the first embodiment shown in 
Fig. 2 has all of the type-A to type-D electronic-watermark 
extracting apparatuses as the organization 400 according to 
the second embodiment, and the organizations 201 and 202 
have the common -electronic -watermark extracting apparatuses 

25 205 in the same way as in the third embodiment, for example. 
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the organizations 203 and 204, which do not have the common- 
electronic -watermark extracting apparatus 205, execute the 
same processing as in the first embodiment, and the 
organizations 200, -MrOT, and 202 can extract electronic- 
5 watermark information by the use of the common-electronic- 
watermark extracting apparatuses 205 within their 
organizations as in the second and third embodiments. 

With the above cases being included, the present 
invention includes all techniques in which the common- 
10 electronic-watermark method having a high robustness and an 
electronic -watermark method unique to each organization are 
used according to conditions. 
(Fourth embodiment) 

In the embedding systems shown in Fig. 1 and Fig. 3, it 
15 is possible that each organization has the electronic- 
watermark extracting apparatus corresponding to the 
electronic-watermark embedding apparatus and an electronic- 
watermark extracting check is performed before electronic- 
watermark embedding. 
20 This configuration can be applied to the first 

embodiment, the second embodiment, and a combination thereof. 
A fourth embodiment will be described below by referring to 
Fig. 6 with the embodiment shown in Fig. 3 being taken as an 
example . 

25 In Fig. 6, a common -electronic -watermark embedding 
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organization 600 includes the conunon-electronic-watermark 
embedding apparatus 105 and the corresponding conunon- 
electronic-watermark extracting apparatus 205, 
Organizations 601 to 604 have the type-A to type-D 
5 electronic -watermark embedding apparatuses 106 to 109 

employing the electronic -watermark methods unique to the 
organizations and the corresponding the type-A to type-D 
electronic-watermark extracting apparatuses 206 to 209. 
Each of the organizations 601 to 604 registers a 

10 copyrighted material at the organization 600 and asks it to 
embed information by the use of the common-electronic- 
watermark embedding apparatus 105. The organization 600 
checks whether the copyrighted material is not an 
illegitimate copy by the use of the common-electronic- 

15 watermark extracting apparatus 205 before using the conunon- 
electronic-watermark embedding apparatus 105. When it is 
determined by the common -electronic -watermark extracting 
apparatus 205 that the common electronic watermark has been 
embedded in the copyrighted material, the organization 600 

20 asks the embedding-request- source organization or the 
organization identified by the electronic-watermark 
information if there is no problem. When there is no 
problem, the organization 600 sends back predetermined 
information to the embedding-request -source organization by 

25 the common -electronic -watermark embedding apparatus 105. 



- 28 - 

The embedding - reques t - s ource organization embeds various 
types of information by the use of the electronic-watermark 
embedding apparatus, one of the apparatuses 106 to 109. 
According to the system of the present embodiment, 
5 electronic-watermark overwriting caused by an illegitimate 
report of a requester can be prevented. In addition, an 
efficient system is implemented because an electronic - 
watermark embedding organization and an electronic -watermark 
extracting organization are integrated as a unit . 

10 A recording medium according to another embodiment of 

the present invention will be described below. 

The present invention is not limited to cases in which 
the systems and the apparatuses described in the above 
embodiments are combined. The present invention also 

15 includes cases in which a software program code for 

implementing each of the above embodiments is sent to the 
systems or the computers (CPUs or MPUs) of the apparatuses 
and the systems or the computers of the apparatuses operate 
the above -described various devices according to the program 

20 code to implement each of the above embodiments. 

In these cases, the program code of the software itself 
implements the functions of the above embodiments. 
Therefore, the present invention includes the program code 
itself, and means for sending the program code to a computer, 

25 specifically, a recording medium for storing the program 
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code. 

As recording media for storing the program code, 
semiconductor memories such as ROMs and RAMs, floppy disks, 
hard disks, optical disks, magneto-optical disks, CD-ROMs, 
5 magnetic tape, and non-volatile memory cards can be used. 

The present invention includes the program code not 
only in cases in which the computers control various devices 
only according to the sent program code to implement the 
functions of the above -described embodiments, but also in 
10 cases in which the program code implements the above- 
described embodiments together with the operating systems 
operating on the computers or with other application 
software programs. 

The present invention also includes a case in which a 
15 program code is stored in a memory provided for a function 
extending board or a function extending unit connected to a 
computer; a CPU provided for the function extending board or 
the function extending unit executes a part or the whole of 
actual processing; and the above -described embodiments are 
20 implemented by the processing. 

As described above, according to the above embodiments, 
even in a system which uses different electronic -watermark 
methods, a monitoring organization efficiently monitors 
illegitimate copying without having many electronic- 
25 watermark embedding apparatuses and many electronic- 
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watermark extracting apparatuses . Improved safety is 
provided even in a case in which an electronic watermark is 
not found, as compared with a case in which each electronic- 
watermark method is used alone. 



